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Abstract 

We  consider  a  three-step  three-player  complete  information  Colonel 
Blotto  game  in  this  paper,  in  which  the  first  two  players  fight  against 
a  common  adversary.  Each  player  is  endowed  with  certain  amount  of 
resources  at  the  beginning  of  the  game,  and  the  number  of  battlefields 
on  which  a  player  and  the  adversary  fights  is  specified.  The  first  two 
players  are  allowed  to  form  a  coalition  if  it  improves  their  payoffs.  In 
the  first  stage,  the  first  two  players  may  add  battlefields  and  incur 
costs.  In  the  second  stage,  the  first  two  players  may  transfer  resources 
among  each  other.  The  adversary  observes  this  transfer,  and  decides 
on  the  allocation  of  its  resources  to  the  two  battles  with  the  players. 

At  the  third  step,  the  adversary  and  the  other  two  players  fight  on  the 
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updated  number  of  battlefields  and  receive  payoffs.  We  characterize 
the  subgame-perfect  Nash  equilibrium  (SPNE)  of  the  game  in  vari¬ 
ous  parameter  regions.  In  particular,  we  show  that  there  are  certain 
parameter  regions  in  which  if  the  players  act  according  to  the  SPNE 
strategies,  then  (i)  one  of  the  first  two  players  add  battlefields  and 
transfer  resources  to  the  other  player  (a  coalition  is  formed) ,  (ii)  there 
is  no  addition  of  battlefields  and  no  transfer  of  resources  (no  coali¬ 
tion  is  formed) .  We  discuss  the  implications  of  the  results  on  resource 
allocation  for  securing  cyber  physical  systems. 


1  Introduction 

Colonel  Blotto  game  models  a  scenario  in  which  two  players  having  certain 
resource  levels  hght  over  a  hnite  number  of  battlehelds.  The  players  decide  on 
the  amount  of  resource  they  deploy  on  each  battleheld  in  order  to  maximize 
their  payoff. 

The  case  of  players  with  symmetric  resources  and  three  battlehelds  was 
solved  by  Borel  and  Ville  in  [1]  in  1938.  Gross  and  Wagner  [2]  general¬ 
ized  the  result  of  symmetric  resources  to  an  arbitrary  number  of  battlehelds; 
they  also  derived  a  Nash  equilibrium  of  the  game  when  there  are  two  battle¬ 
helds  and  asymmetric  resources  among  the  players.  Until  2006,  two-players 
asymmetric-resource  Colonel  Blotto  game  with  more  than  two  battlehelds 
remained  unsolved.  Roberson  [3]  completely  characterized  the  equilibria  for 
this  case  in  2006. 

Following  the  fundamental  work  of  [3]  and  [4],  many  interesting  theoret¬ 
ical  extensions  followed,  and  numerous  papers  targeting  specihc  domain  of 
application  are  published;  see  for  example  [5],  [6,  7],  [8],  [9]  among  many 
others.  There  have  also  been  experimental  studies  for  various  applications  in 
[10],  [11],  [12]  among  many  others.  One  of  the  hrst  experimental  studies  that 
looked  into  network  infrastructures  is  [13].  Another  interesting  experimental 
paper  is  [14]  where  the  authors  study  social  interactions  using  a  Facebook  ap¬ 
plication  called  “Project  Waterloo” ,  which  allows  users  to  invite  both  friends 
and  strangers  to  play  Colonel  Blotto  against  them. 

Two  interesting  variations  of  Colonel  Blotto  game  are  considered  in  [6] 
and  [7].  Kovenock  et.  ah  in  [6]  include  an  extra  stage  to  Blotto  game, 
during  which  both  players  could  add  extra  battlehelds  to  the  initial  number 
of  battlehelds  by  paying  a  cost.  The  authors  investigate  the  parameters 
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of  the  game  for  which  additional  battlehelds  are  added  in  equilibrium.  In 
[7],  Kovenock  and  Roberson  study  a  two-stage  game  in  which  a  common 
adversary  is  engaged  into  two  Colonel  Blotto  games  with  two  separate,  and 
seemingly  unrelated  players  (possible  allies).  At  the  hrst  stage  of  the  game, 
unilateral  transfers  between  the  players  (except  the  adversary)  are  allowed. 
The  authors  demonstrate  that  a  positive  transfer  occurs  (or  in  other  words, 
a  coalition  is  formed)  for  a  range  of  parameter  conhgurations.  However,  the 
authors  do  not  compute  the  Nash  equilibrium  for  the  two-stage  game. 

In  this  paper,  motivated  by  the  models  of  [6]  and  [7],  we  consider  a  three- 
stage  three-player  game  in  which  the  hrst  two  players  could  do  both:  (i)  add 
battlehelds  at  the  hrst  stage  and  (ii)  transfer  resource  among  each  other  (if  it 
improves  the  expected  payohs  to  both  players)  at  the  second  stage.  The  third 
player  is  the  adversary,  who  observes  the  updated  number  of  battlehelds  and 
the  amount  of  resource  transferred  among  the  players,  and  then  allocates  its 
resource  to  the  battles  with  two  players  at  the  second  stage.  In  the  third 
stage,  each  player  among  the  hrst  two  players  hghts  against  the  adversary 
on  the  updated  number  of  battlehelds.  Our  main  contribution  is  that  we 
compute  the  subgame-perfect  Nash  equilibrium  (SPNE)  of  the  three-stage 
game  in  certain  regions  of  the  parameter  space. 

Such  settings  allow  us  to  gain  insights  into  resource  allocation  decisions  of 
network  parties,  facing  a  common  adversary  with  known  resources.  For  ex¬ 
ample,  consider  two  resource-constrained  networks  of  servers  and  a  resource- 
constrained  hacker  who  wants  to  access  the  servers.  The  options  available 
to  the  network  operators  are  to  invest  in  additional  servers  (equivalent  to 
adding  battlehelds  in  our  model)  and  share  resources  among  each-other  for 
securing  the  servers.  The  hacker  observes  the  security  level  of  each  network 
and  decides  on  the  amount  of  resource  it  deploys  to  hack  each  of  the  servers 
of  the  two  networks.  The  main  questions  we  would  like  to  answer  in  this  set¬ 
ting  are  (i)  When  is  it  better  for  network  operators  to  add  additional  servers? 
(ii)  When  should  the  network  operators  share  their  resources  to  make  their 
network  more  secure  and  improve  their  expected  payohs?  (iii)  What  is  the 
behavior  of  the  hacker  in  such  a  scenario? 

1.1  Outline  of  the  paper 

We  formulate  the  three-stage  Colonel  Blotto  game  in  Section  2.  In  Section 
3,  we  recall  the  results  about  Nash  equilibrium  and  expected  payohs  to  the 
players  of  the  static  Colonel  Blotto  game  from  [3].  Thereafter,  we  compute 
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the  SPNE  of  the  three-stage  game  in  Section  4  in  certain  parameter  regions 
of  the  game.  We  conclude  our  discussion  in  Section  5. 

1.2  Notations 

For  a  natural  number  N,  we  use  [N]  to  denote  the  set  {1, . . .  ,N}.  M+  and 
Z_|_  respectively  denote  the  set  of  all  non-negative  real  numbers  and  integers. 
Let  Xi,i  G  [N]  be  non-empty  spaces  and  consider  xi  G  Xi,...,xn  G  dfjv. 
Then,  xi:n  denotes  the  set  {xi, . . . ,  xn}  and  denotes  the  product  space 
Xi  X  ■  •  •  X  Xff. 


2  Problem  Formulation 

We  now  formulate  the  three-stage  three-player  Colonel  Blotto  game  in  this 
section.  This  is  a  complete  information  game,  that  is,  at  second  and  third 
stages  of  the  game,  the  actions  taken  by  the  players  in  the  previous  stages 
are  common  knowledge.  The  hrst  two  players  hght  against  an  adversary,  call 
it  A.  Hereafter,  we  use  Player  3  and  A  interchangeably  for  the  adversary. 
Players  1  and  2  are  allowed  to  transfer  resources  among  each  other  at  the 
second  stage  of  the  game  if  it  improves  their  payoff.  This  act  of  transferring 
a  positive  amount  of  resource  can  be  thought  of  as  a  formation  of  coalition 
among  the  players. 

The  initial  endowment  of  Player  i  G  {1,2}  and  the  adversary,  respectively, 
are  denoted  by  /3j  and  a.  The  initial  number  of  battlehelds  on  which  the 
battle  between  Player  i  G  (1,  2}  and  the  adversary  will  take  place  is  denoted 
by  Hi,  and  each  battleheld  carries  a  payoff  denoted  by  u*  >  0.  We  assume 
that  Ui  >  3  for  i  G  (1,  2}. 

2.1  Information  Structures  and  Strategies  of  the  Play¬ 
ers 

The  model  of  the  game  and  parameters  of  the  game  are  common  knowledge 
among  the  players  before  the  game  begins.  At  the  hrst  stage,  based  only 
on  the  model  and  the  parameters  of  the  game.  Player  i  G  {1,2}  decides  on 
a  non- negative  integer  m*  G  Zi+,  which  denotes  the  number  of  battlehelds 
Player  i  wants  to  add  to  the  existing  battlehelds,  and  pays  a  cost  cm^,  where 
we  assume  c  >  0.  The  adversary  does  not  take  any  action  at  the  hrst  stage. 
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The  actions  taken  by  the  players  at  the  first  stage  are  common  knowledge 
at  the  second  stage.  The  second  stage  consists  of  two  time  steps.  At  the  hrst 
time  step,  the  first  two  players  may  choose  to  transfer  resources  among  each 
other.  We  let  tij  :  — )■  [0,/3j]  denote  the  strategy  of  Player  i,  which  is  the 
amount  of  resource  resource  Player  i  transfers  to  Player  j  ^  i,  i,j  G  {1,2} 
as  a  function  of  the  number  of  battlehelds  added  by  both  players  at  the  hrst 
stage  of  the  game.  We  assume  that  =  0  for  i  G  (1,  2}.  We  use  r*  to  denote 
the  amount  of  resource  available  to  Player  i  G  (1,  2}  after  the  redistribution 
of  resources.  This  is  given  by 

2 

=  A  +  ^  ~  (1) 

i=i 

The  actions  of  the  hrst  two  players  (that  is,  the  amount  of  resources  trans¬ 
ferred)  are  observed  by  the  adversary  at  the  second  step  at  this  stage  of  the 
game.  The  adversary  then  decides  on  the  amount  of  resource  it  allocates 
to  the  battle  with  each  player.  In  particular,  the  adversary  decides  on  two 
functions  o;*  :  Z^  x  [0,  /di]  x  [0,  [32]  — )■  [0,  a]  subject  to  the  constraint  that 
tl, 2^2,1)  +  Oi2{mi-2,  ^1,2;  A,l)  <  «• 

We  now  consider  the  third  stage  of  the  game  in  which  the  adversary 
engages  in  two  battles  against  the  hrst  two  players.  At  this  stage,  the  players 
(including  the  adversary)  know  the  number  of  battlehelds  added,  the  transfer 
among  the  hrst  two  players  and  the  adversary’s  allocation  of  the  resource  to 
each  battle.  Given  this  information,  each  player  needs  to  decide  on  the 
amount  of  resource  it  deploys  on  each  battleheld.  Thus,  the  hnal  stage  of 
the  game  consists  of  two  static  Colonel  Blotto  games. 

For  a  given  triple  o;*,  G  M+  and  G  Z+,  let  us  dehne  the  sets 

rii+rrii 

{ai^kVk^r^  C  M+  ;  ^  ai^k  =  a* 

k=l 

rii+mi 

{l^i,k}T=r'  C  M+  ;  ^  f3i,k  =  Ti 

k=l 

At  the  hnal  stage,  the  adversary  hghts  against  Player  i  G  (1,  2}  on  n*  -|-  rrii 
number  of  battlehelds,  where  the  resource  levels  of  Player  i  and  the  adversary, 
respectively,  are  r*  and  ctj.  It  is  well  known  that  if  the  number  of  battlehelds 
is  greater  than  two,  then  Nash  equilibrium  of  the  players  in  static  Colonel 


Ai{ai,mi)  ;= 
Bi{ri,mi)  :  = 
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Blotto  game  exists  only  in  mixed  strategies  [3].  Therefore,  the  action  space 
of  Player  i  G  {1, 2}  is  rrii)),  whereas  the  action  space  of  the  adversary 

is  nLi 

Henceforth,  we  use  7*  to  denote  the  strategy  of  Player  i,  which  is  defined 
as  follows: 


7*  :=  e  {1,2} 

7^  :=  {ai,. . . 

where  /i*  :  x  x  — )•  p{Bi{ri,mi))  and  z/j  :  Z^  x  x  — )• 

p{Ai{ai,  rrii)),  respectively,  denote  the  strategies  of  Player  i  G  (1,  2}  and  the 
adversary  in  the  battle  between  them  at  the  third  stage  of  the  game.  Thus, 
each  7*  is  a  collection  of  functions  and  the  set  of  all  such  7*s  is  denoted  by 
Ph  For  ease  of  exposition,  we  drop  the  arguments  of  all  functions  Uj,  r*,  a,, 
Hi,  and  Ui  i,j  G  {1,2}  in  subsequent  discussions,  and  use  the  same  notation 
to  denote  the  actions  taken  by  the  player. 

2.2  Payoff  Functions  of  the  Players 

At  the  third  stage  of  the  game,  let  us  use  and  ai^k  to  denote,  respectively, 
the  amount  of  resource  Player  i  and  adversary  deploy  on  battlefield  k  G 
[nj+ruj].  On  every  battlefield  k  G  [uj+mj],  the  player  who  deploys  maximum 
amount  of  resource  wins  and  receives  a  payoff  u,.  In  case  of  a  tie,  the  players 
share  the  payoff  equallyh  We  let  Pi,k{Pi,k,  C(i,k)  denote  the  payoff  that  Player 
i  receives  on  the  battleheld  fc,  and  it  is  given  by 

{Vi  l3i^k  ^  Oii,ky 
^  (^i,k  —  CX.i,ki 

0  otherwise, 

for  i  G  {1, 2}  and  fc  G  {1, . . . ,  ni+rrii}.  The  adversary’s  payoff  on  a  battlefield 
k  in  the  battle  with  Player  i  is 

pfkWi,kj  Oii,k)  =  ~  Pi,k{/3i,k,  Oli,k)  ■ 

^It  should  be  noted  that  if  players  play  according  to  the  Nash  equilibrium  strategies 
on  the  battlehelds,  then  the  case  of  both  players  having  equal  resource  on  a  battleheld 
has  a  measure  zero.  Therefore,  in  equilibrium,  the  tie  breaking  rule  does  not  affect  the 
equilibrium  expected  payoffs. 
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We  use  TTj  to  denote  the  expected  cost  functional  of  Player  i  as  a  function  of 
the  strategies  of  all  players.  This  is  given  by 


=  E 

=  E 


ni+rrii 


^  ^  Pi,k{l3i^k^  (^i,k') 

k=l 

N  rii+mi 

^  ^  ^  ^  Pi,ki.Pi,kj  Oii,k) 


crn^i, 


2=1  k=l 


ze{i,2}, 


where  the  expectation  is  taken  with  respect  to  the  probability  induced  on 
the  random  variables  {Pi,k,o:i,k}i,k  by  the  choice  of  strategies  of  the  players 
in  the  game.  The  model  of  the  game  and  the  payoff  functions  are  common 
knowledge  among  the  players.  The  Colonel  Blotto  game  formulated  above  is 
referred  to  as  CB(n,  /3,  a,  n,  c). 

A  three-tuple  of  strategies  {7^*,  7^*,  7^*}  is  said  to  form  a  Nash  equilib¬ 
rium  if 

7ri(7^'^*)  >  7ri(y,7"**), 


for  all  possible  7*  G  T*,  z  G  [3].  Since  this  is  a  game  of  perfect  information  with 
stagewise  additive  payoff  functions,  we  can  compute  the  subgame-perfect 
Nash  equilibrium  (SPNE)  of  the  game.  SPNE  of  a  complete  information 
game  is  a  rehnement  of  Nash  equilibria  of  the  game,  which  can  be  computed 
using  a  backward  inductive  algorithm.  We  refer  the  reader  to  [15,  p.  72]  and 
[16,  Dehnition  5.14,  p.  250]  for  the  precise  dehnition  and  properties  of  SPNE 
of  complete  information  games. 


2.3  Research  Questions  and  Solution  Approach 

We  want  to  investigate  the  conditions  under  which  in  the  game  dehned  above, 
a  coalition  is  formed  in  which  the  players  transfer  resources,  or  add  additional 
battlehelds.  In  particular,  we  want  to  know  when 

1.  There  is  a  positive  transfer  from  one  player  to  another.  Note  that  in  this 
scenario,  the  transfer  should  increase  or  maintain  the  payoffs  to  both, 
the  donating  player  as  well  as  the  player  who  accepts  the  donation. 

2.  There  is  no  transfer  among  the  players  at  the  second  stage. 

3.  The  adversary  allocates  all  its  resource  to  hght  only  one  player. 


7 


4.  The  players  have  an  incentive  to  add  new  battlehelds. 

We  hrst  recall  some  preliminary  results  on  the  two-player  static  Colonel 
Blotto  game  from  [3].  Solving  the  general  problem  formulated  above  is  some¬ 
what  difficult  due  to  discontinuity  of  expected  payoff  functions  as  a  function 
of  endowments  of  the  players  in  the  static  game.  Therefore,  we  restrict  our 
attention  to  a  subset  of  all  possible  parameter  regions  in  order  to  keep  the 
analysis  tractable.  We  compute  the  parameter  regions  that  feature  the  sce¬ 
narios  listed  above  in  Section  4. 

Our  analysis  of  the  subgame  starting  at  the  second  stage  is  similar  to 
the  one  considered  in  [7].  However,  the  authors  in  [7]  do  not  compute  the 
Nash  equilibrium  of  the  game;  they  restricted  their  attention  to  computing 
the  best  response  strategies  of  the  players.  We  derive  here  the  SPNE  of  the 
game  formulated  above.  Furthermore,  we  have  been  unable  to  verify  some 
of  the  assertions  made  in  [7].  Therefore,  in  this  paper,  we  state  the  complete 
proof  of  all  the  results  presented  in  this  paper,  so  that  our  treatment  is  self 
contained. 


3  Preliminary  Results  on  Static  Two-Players 
Colonel  Blotto  Game 

Consider  a  two-players  static  Colonel  Blotto  game  with  n  battlefields.  We 
let  Ti  denote  the  resource  of  Player  i.  Dehne  IZi  :=  {a  G  M"  : 
and  let  dTZi  be  the  boundary  of  the  region  T^j.  Then,  the  strategy  of  Player 
i  is  a  joint  measure  over  the  space  TZi.  Let  /ij  G  p(JZi)  be  the  strategy  of 
Player  i.  Then,  we  let  Pr^t/r*  denote  the  marginal  of  jii  on  the  battleheld. 

A  player  wins  a  battleheld  if  he  deploys  strictly  larger  amount  of  resource 
as  compared  with  the  other  player  on  that  battleheld.  In  case  of  a  tie  (both 
players  deploying  equal  resources),  the  payoh  is  equally  divided  between  the 
players.  The  payoh  of  winning  a  battleheld  is  given  by  v.  Due  to  the  cost 
functionals  of  the  players,  for  a  given  strategy  pair  (/ii,p2)  of  the  players, 
the  expected  cost  to  Player  i  on  battleheld  k  G  [n]  is  dependent  solely  on  the 
marginal  distributions  (Pr^tpi,  Pr|^/i2). 

The  resources  available  to  the  players  and  the  number  of  battlehelds  are 
common  knowledge  among  the  players.  We  call  this  Colonel  Blotto  game  as 
SCB({l,ri},  {2,  r2},  n,  v).  We  now  recall  the  following  result  from  [3]. 


Theorem  1  Let  ;  p{TZi)  — )■  denote  a  set-valued  map  (correspon¬ 

dence),  defined  as 


:=  |/ii  e  piTZi)  :  supp{fii)  =  supp{p,i)  and 


For  the  static  Colonel  Blotto  game  SCB{{l,ri\,{2,r2},n,v)  with  n  >  3, 
there  exists  a  Nash  equilibrium  pCf)  with  unique  payoffs  to  each  player. 
Let  :=  Pi^ptf  for  i  G  {1,2}  and  k  E  [n].  Any  Nash  equilibrium  of  the 
game  satisfies  following  properties: 

1.  For  Player  i,  Pr^fi)  =  =  ■  ■  •  =  Pr^pf. 

2.  If  is  a  Nash  equilibrium  of  the  game,  then  supp{p*)  =  dLZi  for 

3.  If  {fif  fif)  is  any  other  Nash  equilibrium  of  this  game,  then  Pi^pf  = 
Llk- 

4-  If  {pi,  P2)  is  a  set  of  strategies  such  that  supp{pi)  =  supp{p*)  =  dUi 
and  Pr^Pi  =  p*j.,  then  {pi,  P2)  is  a  Nash  equilibrium  of  the  game 
SCB{{l,ri},{2,r2},n,v). 

Thus,  {pi,  P2)  is  a  Nash  equilibrium  if  and  only  if  pi  G  '^fip*)  for  both  players 
ie{l,2}. 

Proof:  See  [3]  for  a  proof  of  the  above  results.  ■ 

We  let  NE(SCB({l,ri},  {2,r2},n,  u))  denote  the  set  of  all  Nash  equilib¬ 
ria  of  the  static  Colonel  Blotto  game  SCB({1,  ri},  (2,  r2},  n,  u).  It  should 
be  noted  that  even  though  there  are  several  Nash  equilibria  of  the  game 
SCB({1,  ri},  (2,  r2},  n,  u),  the  marginals  on  all  battlehelds  of  all  equilibrium 
strategies  of  Player  i  are  the  same. 

Lemma  2  For  the  static  Colonel  Blotto  game  SCB{{1,  rff,  (2,  r2},  n,  v)  with 
n  >  3,  suppose  that  ri  and  r2  are  such  that  <  n  —  1.  Then,  the 
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payoff  functions  of  the  players  under  Nash  equilibrium  {pf,  pf)  given  by 


P\SCB{{fr,],{2,rf^,n,v)) 


F2(5C'S({l,rl},{2,r2},n,^;)) 

=  nv-  P^(5C'F({l,ri},{2,r2},n,'i;)). 


If  ri  =  0,  then  P^(5C'F({1,  0},  {2,  r2},  n,  v))  =  0. 

Remark  1  Notethat  for  a  fixedr2,n  andv,  ri  P^{SCB{{l,ri},  {2,r2},n,v)) 
is  a  concave  monotonically  increasing  function  in  the  parameter  region  < 

^  <  n  —  1.  This  is  also  illustrated  in  Figure  1  for  a  specific  set  of  parame¬ 
ters.  Furthermore,  ri  i— >■  P^(iS'C'R({l,  ri},  {2,  r2},  n,  u))  is  a  non- decreasing 
function  on  M+.  This  is  a  consequence  of  the  result  in  [3].  □ 


4  SPNE  of  the  Three-Stage  Game 


In  this  section,  we  compute  the  subgame-perfect  Nash  equilibrium  for  the 
game  formulated  in  Section  2.  The  SPNE  of  a  complete  information  game 
is  computed  using  a  recursive  algorithm.  First,  the  Nash  equilibrium  for  the 
game  at  the  hnal  stage  is  computed.  Then,  at  any  stage  before  the  hnal  stage, 
the  Nash  equilibrium  for  the  subgame  starting  at  that  stage  is  considered  and 
Nash  equilibrium  is  computed  for  that  game. 

In  what  follows,  we  use  t  :=  fi^2  —  ^2,1  to  denote  the  total  amount  trans¬ 
ferred  from  Player  1  to  Player  2  at  the  second  stage.  The  value  of  t  can 
take  negative  value  if  Player  2  transfers  its  resource  to  Player  1.  We  use 
ri  :=  rfit)  =  fii  —  t  and  r2  :=  r2{t)  =  fi2  +  t  respectively  to  denote  the 
resource  levels  of  Player  1  and  Player  2  after  the  transfer. 

At  the  hnal  stage.  Player  i  G  {1,2}  and  the  adversary  play  a  static 
Colonel  Blotto  game  on  Uj  -|-  m*  battlehelds  with  resource  levels  r*  and  a*, 
respectively.  The  Nash  equilibrium  of  the  static  Colonel  Blotto  game  is  given 
in  Theorem  1.  Thus,  we  have  the  following  result. 
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=  1 ,  n  =  1 1 ,  V  =  0.090909 


Figure  1:  For  a  fixed  resource  r2  of  Player  2,  the  payoff  to  Player  1  is  concave 
function  of  its  endowment  of  resources  ri. 
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Lemma  3  At  the  final  stage,  Player  i  G  {1,2}  and  the  adversary  play  a 
static  Colonel  Blotto  game  SCB{{l,ri},  (2,  a*},  nj+rrii,  Wi).  Thus,  the  SPNE 
at  the  last  stage  is  any  pair  of  strategies  {pf,  u*)  G  NE{SCB{{1,  rj},  (2,  ai},  ni+ 

mi,  Vi)). 

As  a  consequence  of  the  lemma  above,  we  only  need  to  compute  the  SPNE 
strategies  of  the  players  at  the  hrst  two  stages.  We  now  restrict  our  analysis 
to  a  subset  of  all  possible  parameter  regions  in  order  to  keep  it  tractable.  In 
particular,  we  focus  our  attention  to  only  those  games  in  which  if  players  act 
according  to  SPNE  at  the  hrst  two  stages,  then  the  ratio  of  and  ctj  lies  in 
the  interval  (^,  y),  either  for  both  i  G  {1,2}  or  ctj  =  0  for  some  i  G  {1,2}. 
With  this  simplihcation,  there  are  only  four  possible  cases: 

1.  2/ni  <  ai/ri  <  1  and  2/n2  <  a2/r2  <  1 

2.  2/ni  <  ri/ai  <  1  and  2/n2  <  ^2/0:2  <  1 

3.  2/ni  <  ai/ri  <  1  and  2/n2  <  ^’2/0:2  <  1 

4.  2/ni  <  ri/ai  <  1  and  2/n2  <  Oi2/r2  <  1 

However,  Case  4  above  is  just  Case  3  with  index  of  the  players  interchanged. 
Therefore,  we  compute  the  SPNE  of  the  game  here  only  for  the  hrst  three 
cases.  Toward  this  end,  we  hrst  compute  the  reaction  curve  of  the  adversary 
at  the  second  stage  in  the  next  subsection. 


4.0.1  Preliminary  Notation  for  Results 

ae  some  notation 
ai(mi,m2,t)  :  = 


We  now  dehne  some  notation  that  we  use  throughout  the  rest  of  the  paper. 

01 


1  + 


{n2+m2)v2{fi2+i) 

(ni+mi)t)i(/3i-t) 


a2{mi,m2,t)  :=  a  -  ai(mi,  m2,  t), 

Ai(mi,m2,t)  :  = 


(n2  +  m2)v2{l3i  -  t){fi2  +  t) 


(ni  +  mi)ni 


d{mi,  m2,  t)  :  = 
a 

0 

a  u>.p.  p  €  (0, 1)  if 


•  r  (ni+mi)ui  {n2+m2)v2 

Pl-t  ^  g2+t 
•r  (ni+mi)tii  ^  {n2+m2)v2 

^  ,  /32+t 
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4.1  Best  Response  of  the  Adversary 

We  first  compute  the  best  response  strategies  (also  called  reaction  curves 
[16])  of  the  adversary  in  the  game. 

Lemma  4  Consider  a  game  CB(n, /I,  a,  n,  c).  For  atE  [— /92,/3i],  let  ri  = 
Pi  —  t  and  r2  =  P2  +  t.  Fix  mi,  m2  €  Zi+.  The  strategy  of  the  adversary  that 
maximizes  its  payoff  is: 

1.  If  — X —  <  ~ 

^  ni+mi  pi-t  n2  P2+t  ^ 

a\{mi,m2,f)  =  d{mi,m2,t). 


1/  — ^  <  -r-^ — Ts  <  1, 

^  rii+mi  ai(mi,m2,f)  ’ 


i  =  1,2,  then 


a\{mi,m2,f)  =  ai(mi,m2,t). 


3.  If 


2 

ni+mi 


< 


hi-t 


< 


h2+t 


n2+m2  Xi{mi,m2,t) 


<  1,  then 


al{mi,  m2,  t)  =  a  —  Xprni,  m2,  t). 


Proof:  Since  Player  i  and  the  adversary  are  going  to  play  a  static  Colonel 

Blotto  game  SCB({i,  rp,  {A,  aff,  Ui  +  mi,  vp  at  the  hnal  stage  of  the  game, 
the  expected  payoff  functions  to  the  players  are  given  by  the  result  of  Lemma 
2  (that  are  dependent  on  the  ratio  rj/oj). 

The  reaction  curve  for  the  adversary  is  the  best  response  strategy  of  the 
adversary  given  the  strategy  of  the  other  two  players.  Towards  this  end,  £x 
mi:2  and  t  and  define  e*  :=  (n*  +  mpVi  for  i  =  1,2.  The  expected  payoff 
function  to  the  adversary  as  a  function  of  the  adversary’s  allocation  ai  to 
the  battle  with  Player  1  for  the  three  cases,  respectively,  are 


Case  1:  7r^(ai) 
Case  2:  7r^(ai) 

Case  3:  7r^(ai) 


Cidi  62(0;  —  Oi) 


+ 


2{Pi  -  t)  2{P2  +  t) 

.01- 'ft-*)' 


+62  1  - 


2Q!i 

{P2  + 1) 

2{a  —  ap 


•> 


eidi  /  {P2  +  ^)  \ 

2(A-<)  +  2(a-aOT 
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In  Cases  2  and  3,  the  payoff  to  the  adversary  tt^  is  a  concave  function  of  ai, 
since  the  second  derivative  of  tta  with  respect  to  ai  is  strictly  negative.  One 
can  set  the  hrst  derivative  of  tia  to  zero  to  get  the  optimal  value  of  ai  as  a 
function  of  mi,  m2,  and  t.  The  fact  that  d{mi,m2,t)  maximizes  the  payoff 
Ha  in  Case  1  can  be  verihed  easily.  This  completes  the  proof  of  the  lemma. 


We  are  now  in  a  position  to  compute  the  SPNE  of  the  game  considered  above. 
We  hrst  consider  in  the  next  subsection  the  case  when  the  adversary  has  least 
amount  of  resources  as  compared  to  other  players  of  the  game.  Thereafter, 
we  consider  other  cases  of  the  game. 


4.2  Adversary  with  Least  Resources 

We  now  turn  our  attention  to  computing  SPNE  of  the  three-stage  Colonel 
Blotto  game  formulated  in  Section  2.  First,  we  consider  a  case  when  the 
adversary  has  the  least  amount  of  resources  among  all  players.  We  show 
that  if  the  parameters  of  the  game  satisfy  certain  assumptions,  then  there 
exists  a  family  of  SPNE  in  this  game. 


4.2.1  Preliminary  Notation  for  Theorem  5 

Let  mi  =  argmaxmiez+ ~  cmf  and  m2  =  argmaXm2ez+ —  cm^. 
Dehne 


t2,i(mi,m2) 

Cl 


(n2  -h  m2)u2/9i  -  (^1  +  'mi)vi/32 
{ni  +  mi)vi  +  {n2  +  m2)v2 
{rii  +  mi)vij32  -  {n2  +  m2)u2/^i 
{ni  +  mi)vi  +  {n2  +  m2)v2 
t2,i(0,m2)  C2  =  h,2(mi,0). 


Theorem  5  Consider  a  game  CB(u, /3,  a,  u,  c)  with  a  <  min{/?i,/32}  and 
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^  <  j:  for  i  E  {1, 2}.  If  the  parameters  of  the  game  satisfy  either 


{ni  +  mi)vi  ^  n2V2 


/Si 


< 


/S2  ’ 
a 


1  - 


a 


2(/52  +  C2) 


V2  <  C, 


or 


ni  +  mi  (3i-  C2 
niVi  {n2  +  rfi2)v2 


2  a 

<  o  ^ 


Pi 


> 


P2 


n2  P2  +  C2 

a 


2(/Si  +  Cl) 


Vi  <  c, 


2  a  2  a 

<  ^  <1,  —  <  7, - ^  <  1, 


712  +  m2  P2-  Cl  ni  Pi  +  Cl 

then  there  is  a  family  of  SPNEs  for  this  game  given  by 

ai(mi,m2)  =  c?(mi,m2,t), 
ti  2(7771,  m2)  = 


t  e  [0,^1,2(7711,  m2))  if  < 


(ni+mi)Di  ^  {n2+m2)v2 

h 

otherwise 


t2,i(777i,m2)  = 

t  E  [0,  t2,i("^i)  "^2))  if 


(ni+mi)i;i  ^  (n2+m2)D2 


otherwise 


(2) 


(3) 


m,  = 


mn  = 


mi 

Y  {'n.l+fh-i)vi 

J  /3i 

^  n2V2 
^  ^2 

0 

otherwise 

7772 

niVi  ^  {n2+m2)v2 

•’  Pi  02 

0 

otherwise 

T/ins,  along  the  eguilihrium  path,  one  player  has  an  incentive  to  add  battle¬ 
fields  and  transfer  some  (or  none)  of  its  resource  to  the  other  player. 

Proof:  See  Appendix  5.  ■ 


Remark  2  In  the  theorem  above,  if  c  >  vi,  then  mi  =  0.  Similarly,  if 
c  >  V2,  then  777,2  =  0.  □ 

In  the  theorem  above,  there  are  three  important  points  to  notice:  The  hrst 
point  is  that  the  adversary  randomizes  its  action  when 


l32+t 
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Suppose  <  {■n’2+m2)v2  ^  g^g  ^  iucieases,  increases  while 

decreases.  The  two  quantities  and  become  equal 

exactly  when  t  =  ''^2)-  Thus,  Player  1  will  never  transfer  an  amount 

equal  to  ti,2(^i,^2)  in  this  case  since  this  action  reduces  its  payoff.  This  is 
the  reason  why  we  see  that  Player  1  transfers  any  amount  t  in  the  interval 
[0,  ti,2(nri,  m2))  when  playing  according  to  the  SPNE. 

The  second  point  to  notice  is  that  one  player  adds  battlehelds  as  well  as 
transfer  its  resource  to  the  other  player  if  the  value  c  is  small  enough.  The 
third  point  to  note  is  that  the  player  transferring  its  resource  to  the  other 
player  is  the  one  with  minimum  ^^d  not  necessarily  the  player  who 

has  maximum  resource  level  (3i.  This  is  contrary  to  our  intuition.  A  take 
away  from  this  result  is  that  the  rich  player  need  not  always  be  better  off 
in  a  war  as  it  may  have  more  and/or  highly  valued  battlehelds  to  hght  on. 
This  phenomena  is  also  illustrated  numerically  in  Figure  2.  In  the  red  region, 
even  though  Player  1  has  less  resource  than  Player  2,  Player  1  may  choose 
to  transfer  some  of  its  resource  to  Player  2.  We  now  consider  other  scenarios 
in  the  next  subsection. 


4.3  Other  Cases 

In  this  subsection,  we  consider  the  case  in  which  the  adversary  has  compara¬ 
ble  or  more  resource  than  that  of  the  other  players.  The  SPNE  of  the  game 
in  such  a  case  is  as  follows. 


4.3.1  Preliminary  Notation  for  Theorem  6 

f,(m„  m2)  :=  Pmtk  _  (ftjyy 


X  . 


(ni  mi)ni 


(ni  mi)ni  (77,2  m2)v2  ’ 

m2)  :=  (ui  -h  mi)ni 

(ni  -h  mi)ni((ni  mi)vi  -h  (us  -h  m2)v2), 


mi  :=  arg  max  miVi  1  — 

miEZ+ 


a 


Cl  (mi,  m2)  :  = 


2{/3i  +  (^2) 

4(ni  -|-  mi)niQ;^ 

(n2  m2)v2{/3i  +  132^' 


—  cm^, 
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Figure  2:  For  fixed  parameters  ui  =  2,^2  =  1,  c  =  3,  n\  =  8,n2  =  20,  and 
a  =  2,  Player  1  transfers  to  Player  2  in  the  red  region,  whereas  Player  2 
transfers  to  Player  1  in  the  blue  region.  There  is  no  addition  of  battlefield 
by  any  player  (see  also  Remark  2)  in  the  colored  region.  In  the  white  region, 
transfer  may  or  may  not  occur.  See  Theorem  5  for  complete  characterization. 


Theorem  6  Consider  a  game  CB(n, /3,  a,  n,  c).  The  SPNE  of  the  game  is 
given  as 


1.  Assume  c  >  max  {tci(l,  0)  —  tci(0,  0),  ^2}  and  let  ti  :=  m2). 


If 


< 


4q 

rijt) 


<1,  i  =  1,2,  then 


rij+mj  ai{mi,m2,t) 

al{mi,m2,t)  =  ai{mi,m2,t), 


t\2{rni,m2)  = 

f2,i(mi,m2)  =  0, 


Pl-h2 

2/3i/32 


> 


ti  if 
0  otherwise 
m*  =  ml  =  0. 


{ni+mi)vi 

(n2+m2)v2 
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Jf  C  ^  Wi+(^2)v2 
then 


4a 


ni+mi 


< 


<  1,  and 


< 


W2+t) 


n2+m2  Ai  (mi, 012,4) 


<  1, 


a* {nil,  1712,  t)  =  a  —  Ai(mi,  m2,  t). 


t\2{'mi,m2)  = 


Cl(mi,m2)+1 


Pi+h  ^  / (ni+mi)o7^ 

•I  2a  Y  (o2+m2)o2/3l 

otherwise. 


t2,i(mi,  m2)  =  0,  m^  =  mi,  m^  =  0. 


Proof:  See  Appendix  5. 


Remark  3  If  c>  Vi  {l  —  ?  then  mi  =  0,  which  implies  m\  =  0  m 

the  Case  2  above.  □ 

In  the  theorem  above,  there  is  a  unique  transfer  among  the  players,  and 
therefore,  unique  SPNE.  The  first  case  is  that  of  adversary  having  a  signifi¬ 
cantly  larger  amount  of  resources  than  the  sum  of  the  resources  of  the  other 
two  players.  It  is  easy  to  note  that  Player  1  transfers  to  Player  2  in  this 

case  when  >  0)  which  implies  that  fti  >  132.  Thus,  the 

rich  player  transfers  resource  to  the  poor  player.  Furthermore,  the  hrst  two 
players  do  not  add  battlehelds  if  the  value  of  c  is  high  enough. 

In  the  second  case  above,  the  adversary  has  a  comparable  resource  level 
with  respect  to  the  resource  levels  of  the  other  two  players.  In  this  case,  like 
in  the  first  case,  the  rich  player  transfers  resource  to  the  poor  player.  This 
can  be  shown  as  follows:  a  >  Ai(mi,m2,t)  implies 


I3i  +  (32  ^  j{ni  +  mi)vi 

2a  \  {n2  +  ni2)v2 

Also,  Player  1  transfers  resource  to  Player  2  if 


/3l  +  1^2 
2a 

Both  inequalities  can  be  satished  simultaneously  if,  and  only  if,  (3i  >  (32. 
Thus,  only  rich  player  donates  to  the  poor  player  in  this  case.  A  graphical 


(rii  mi)ni 

(77-2  -f  m2)v2 
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v^=1,  V2=1,  c=3,  n^=200,  n2=200,  a=15 


Figure  3:  For  fixed  parameters  ui  =  1,U2  =  1,  c  =  3,  rii  =  200,  n2  = 
200,  and  a  =  15,  Player  1  transfers  to  Player  2  in  the  red  region,  whereas 
Player  2  transfers  to  Player  1  in  the  blue  region.  There  is  no  addition  of 
battlefield  by  any  player  (see  also  Remark  3)  in  the  colored  region.  In  the 
white  region,  transfer  may  or  may  not  occur.  See  Theorem  6  Case  2  for 
complete  characterization.  Note  that  the  graph  is  symmetric  around  /9i  =  (52 
line  because  ni  =  77-2  and  vi  =  V2- 

representation  of  when  a  transfer  occurs  and  who  transfers  whom  is  given  in 
Figure  3. 

In  both  the  cases  above,  it  should  be  noted  that  even  though  both  players 
fight  with  the  adversary,  there  is  a  positive  transfer  of  resource  from  the  rich 
player  to  poor  player.  This  result  was  also  reported  in  [7],  but  the  authors 
did  not  compute  the  equilibrium  behavior.  Even  though  for  every  player, 
higher  resource  implies  higher  payoff  (see  Figure  1),  we  see  that  a  positive 
transfer  takes  place  because  the  adversary  observes  the  amount  of  resource 
transferred  and  changes  its  allocation  appropriately  in  order  to  maximize  its 
payoff. 
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In  Case  2  above,  Player  1  adds  battlefields  as  well  as  transfer  its  resource 
to  Player  2.  This  is  similar  to  the  behavior  we  saw  in  Theorem  5,  where  the 
adversary  had  least  resources  among  all  players.  In  Theorem  5,  the  donating 
player  may  choose  not  to  donate  any  resource;  on  the  contrary,  in  Theorem 
6,  we  saw  that  the  donating  player  must  donate  a  unique  positive  amount 
of  resource  to  the  other  player.  It  should  also  be  noted  that  in  all  the  cases 
above,  if  the  value  of  c  was  small,  then  adding  battlefields  is  beneficial  to 
Players  1  and  2.  We  consider  the  case  of  c  large  enough  here  for  ease  of 
exposition. 

We  now  have  a  qualitative  picture  of  the  behavior  of  resource-constrained 
players  who  could  be  attacked  by  a  common  resource-constrained  adversary. 
Going  back  to  the  example  of  network  operators  and  the  hacker  stated  in 
Section  1,  we  now  know  the  parameter  regions  where  it  is  beneficial  for  the 
network  operators  to  form  a  coalition  for  sharing  resources.  If  the  cost  of 
adding  additional  servers  is  small  enough,  it  is  in  the  best  interest  of  network 
operators  to  add  more  servers.  We  also  know  the  amount  of  resource  the 
hacker  will  allocate  to  hack  the  servers  in  each  network.  In  particular,  if  the 
hacker  has  very  little  resource  as  compared  to  the  network  operators,  then 
the  hacker  attacks  only  one  of  the  networks  (see  Theorem  5  for  details).  If 
the  hacker  has  comparable  or  more  resources  than  the  network  operators,  the 
hacker  divides  its  resource  into  two  parts,  where  each  part  is  used  to  attack 
each  of  the  network  operators  (see  Theorem  6  for  details). 


5  Conclusion 

In  this  paper,  we  formulated  a  three-stage  Colonel  Blotto  game  and  computed 
the  subgame-perfect  Nash  equilibrium  of  the  game  in  various  parameter  re¬ 
gions.  We  showed  that  under  some  sufficient  conditions,  the  players  may 
have  an  incentive  to  add  battlefields  or  form  a  coalition  as  it  improves  their 
expected  payoffs.  We  also  showed  that  when  the  adversary  has  least  amount 
of  resource  among  all  players,  then  the  adversary  fights  against  only  one  of 
the  two  players.  In  several  instances  of  the  game,  counterintuitive  behavior  of 
the  players  emerge,  wherein  one  player  transfers  resource  to  the  other  player 
even  though  both  players  engage  in  battles  against  the  adversary.  In  certain 
parameter  regions,  the  player  with  minimum  resource  among  the  first  two 
players  may  transfer  some  of  its  resource  to  the  other  player.  For  the  future, 
we  would  like  to  extend  the  analysis  to  multi-player  version  of  this  game. 
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Appendix 

Al.  Proof  of  Theorem  5 

The  best  response  strategy  of  the  adversary  is  given  in  Lemma  4.  Assume 
that  (2)  is  satisfied.  Fix  mi  and  m2,  and  assume  that  the  ratio  of  a  and 
fdi  -  U,2("ii,m2)  lies  in  the  interval  and  Ci+^^i)w  ^  {n2+n^^ 

For  this  set  of  parameters,  a\  =  0,  or  in  other  words,  the  adversary  does 
not  fight  Player  1.  If  Player  1  transfers  any  amount  t  of  its  resource  in  the 
interval  [0,  fi,2(^i,  ^2)),  then  jg  strictly  less  than  after  the 

transfer  takes  place.  This  maintains  the  payoff  of  Player  1,  so  it  is  indifferent 
to  transfer.  Any  positive  transfer  to  Player  2  improves  the  payoff  of  Player 
2,  so  it  accepts  the  transfer.  The  case  of  (3)  can  also  be  done  using  the  same 
arguments  with  the  roles  of  Players  1  and  2  reversed. 

Now,  consider  the  total  payoff  functionals  of  the  players  at  the  hrst  stage. 
Maximizing  the  expected  payoff  functionals  of  Players  1  and  2  over  mi  and 
m2  given  Q:i,fi2  and  we  get  the  result.  In  particular,  in  the  case  when 
(2)  is  satished.  Player  1  does  not  fight  against  the  adversary  at  the  third 
stage.  Thus,  adding  rhi  battlefields  improves  its  payoff.  On  the  other  hand, 
since  ^1  —  ^  payoff  reduces  if  it  adds  any  battlefield. 

The  case  of  (3)  using  similar  arguments. 
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The  sufficient  conditions  on  the  parameters  ensures  that  any  player  in 
{1,2}  and  the  adversary’s  allocation  have  appropriate  ratios  if  all  players  act 
according  to  the  SPNE.  The  proof  of  the  theorem  is  complete. 


A2.  Proof  of  Theorem  6 


The  best  response  of  strategy  of  the  adversary  remains  the  same  as  in  Lemma 
4.  We  only  need  to  compute  the  best  response  strategies  of  the  hrst  two 
players  for  the  given  strategy  of  the  adversary.  Let  0i(t)  be  the  payoff  to 
Player  1  if  it  transfers  t  amount  of  resource  to  Player  2. 

1.  For  this  case,  0i(f)  is  given  by 

(A-^) 

PipJ  “  o  ?  id' 

One  can  check  that  <  0  and 

d(j)i  _  {rii  +  mi)vi  I  ^  ^  1  / (n2  +  m2) V2 
dt  2a  I  2V  {ni  +  mi)vi 

,,  (A  -  f^2-  2t)  \ 
y/ (/?1  —  t)(/?2  +  t)  j 


Furthermore,  if  >  2-y/  then  ^  >  0,  that  is,  it  is  bene- 

hcial  for  Player  1  to  transfer  its  resource.  One  can  similarly  compute 
the  expected  payoff  to  Player  2  as  a  function  of  t  and  show  that  it  is 
benehcial  for  Player  2  to  accept  the  transfer.  Since  is  a  concave 
function,  we  can  set  the  derivative  to  zero  to  compute  the  transfer  that 
achieves  the  maximum.  This  gives  us  the  value  of  optimal  amount  of 
resource  2  ^  function  of  mi  and  m2  that  is  transferred  to  Player  2. 

At  the  hrst  stage,  the  expected  payoff  function  of  Player  1  and  2,  re¬ 
spectively,  are 


f3l+  (^2  f 

— ^ - u;i(mi,m2)  -  cm^, 

4a 

/  ,  I  Pi  +  1^2  2 

(77-2  m2)V2 - ^ - cm2. 

4a 


Now,  if  c  >  max  {wi(l,  0)  —  tci(0,  0),  ^2},  then  not  adding  any 
battleheld  yields  maximum  payoff  to  both  players.  Thus,  m}  =  m^  =  0. 
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2.  For  this  case,  0i(t)  is  given  by 


01  (^) 


K +  «.>>-.  (1 - 2(A  - 1)  ) 


The  derivative  of  01  with  respect  to  t  is  given  by 


d(j)i  _  (ni  +mi)via  f  _  (0i  +  ^2) 
dt  2(01  —  I  2q; 


X  - 


(n2  +  7712)^2  / 01  -  t 
(ni  +  mi)niy  02  +  t 


d(f)i 

dt 


>  0  if  t  <  2(^1)  ''^2) 

=  0  if  t  =  2(^1)  ^2) 

<0  if  t  >  ''^2) 


Thus,  if  2(^1) ''^2)  is  positive,  then  Player  1  transfers  2(^1; ''^2) 
amount  of  resource  to  Player  2.  One  can  compute  the  expected  payoff 
to  Player  2  as  a  function  of  t  and  show  that  it  is  benehcial  for  Player 
2  to  accept  the  transfer. 

At  the  hrst  stage,  the  expected  payoff  function  of  Players  1  and  2, 
respectively,  are 


(ni  +  mi)vi  —  cm\  + 


X 


So;  (01  +  02) 
[{n-2  +  m2)n2(0i  +  02)^  -  4(ni  +  nii)via^)  , 

01  +  02 


(n2  +  7712)^2- 


4q; 


crrin 


Now,  if  c  >  then  m\  =  mi  and  =  0  maximizes  the 

expected  payoffs. 

The  proof  of  the  theorem  is  thus  complete. 
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